Roles and Responsibilities

• Design, develop, and maintain scalable and reliable Kafka-based data pipelines.
• Implement and manage ETL processes to handle large volumes of data efficiently.
• Develop and maintain Java/Spring Boot applications to support various business functions.
• Integrate Kafka with other data processing frameworks and storage solutions.
• Collaborate with data analysts, data scientists, and other developers to understand data requirements and deliver robust solutions.
• Ensure data security, integrity, and governance policies are adhered to in all data engineering processes.
• Monitor and manage Kafka cluster performance, job execution, and resource utilization.

Required Qualifications

• 8+ years of experience in software development with a strong focus on Kafka, ETL, and Java/Spring Boot.
• Hands-on experience in the Kafka Messaging system with Topics, Connectors, and Consumer groups.
• Experience in writing Producer and Consumer programs for the Kafka Messaging system.
• Hand-on experience with deploying and implementing applications on the OCP platform.
• Experience with microservices architecture and RESTful API development.
• Knowledge of data modeling, data architecture, and data governance.
• Hands-on experience in Mongo DB.

Posted By